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Abstract 

An important measure of conditioning of a conic linear system is 
the size of the smallest structured perturbation making the system 
ill-posed. We show that this measure is unchanged if we restrict to 
perturbations of low rank. We thereby derive a broad generalization 
of the classical Eckart- Young result characterizing the distance to ill— 
posedness for a linear map. 

1 Introduction 

Consider two finite-dimensional normed spaces X and Y, a fixed convex cone 
K C X, and a linear mapping A : X — > Y. We call A well-posed if AK = Y. 
In particular, in the purely linear case K = X, well-posedness coincides with 
surjectivity. Our interest is in the "distance to ill-posedness" : that is, we 
seek the smallest structured linear perturbation AA : X — > Y such that 
the perturbed mapping A + AA is not well-posed. When K — X and the 
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structure of perturbations is unrestricted, the classical Eckart- Young theorem 
identifies the distance to ill-posedness as the smallest singular value of A. 

For more general convex cones K, and unstructured perturbations, semi- 
nal work of Renegar [8, 9] relates the distance to ill-posedness to the complex- 
ity of solving associated linear programs. Imposing structure on the allowable 
perturbations (in order, for example, to maintain a sparsity pattern in the 
map A) leads to a considerably more involved theory. In the purely linear 
case K — X, such questions arise as "structured singular value" calculations 
in the area of control theory, pioneered by Doyle, known as "/i-analysis" [3] . 

In this article we follow quite closely the approach of Peha [7] in consider- 
ing structured perturbations to general conic systems. We depend heavily on 
the same rank-one reduction technique used in [7] and introduced in [5, 6]. 
Our approach differs in several respects. First, we develop the theory in 
the concise and elegant language of sublinear set-valued mappings (in other 
words, mappings whose graphs are convex cones). This notion substantially 
generalizes the idea of a conic convex system: well-posedness becomes the 
notion of surjectivity of the mapping. (In this framework, the unstructured 
case was developed in [4], and generalized in [2].) Secondly, the structured 
perturbations we consider are rather general, being of the form J2i PiTiQi for 
linear mappings T, (where the linear mappings Pj and Qi are fixed at the 
outset). Thirdly, we allow arbitrary norms on the underlying spaces. Lastly, 
our proofs consist of direct duality arguments, avoiding the necessity of "lift- 
ing" problems into higher dimensional spaces. In this manner we hope to 
illuminate the structural simplicity of the key results. 

The main result is as follows. We consider finite-dimensional normed 
spaces X, Y, U i: Vi, linear mappings Pj : V* — > Y and Qi : X — > Ui (for 
% = 1,2, ... ,k), and a surjective set- valued mapping F : X =4 Y with graph 
a closed convex cone. Then, denoting dual spaces and adjoint mappings by 
*, the following four quantities are equal: 



linear T; 





mm 

u*£U*,Zi>0, 0^y*£Y 



max 



P* 




: 5>Q*< e P*(y*), IK II < 
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2 Rank-one perturbation 



As observed by Pena [5, 6], the idea of rank-one pertubation is fundamental 
to the theory of the distance to ill-posedness. Our first, elementary result 
tries to capture the underlying idea in a way that extends to structured 
perturbations. 

Throughout this article we follow the terminology of [12]. We call a set- 
valued mapping F : X =4 Y positively-homogeneous if its graph 



is a cone (which is to say nonempty and closed under nonnegative scalar 
multiplication). To recapture the theory of conic linear systems we typically 
consider examples of the form 



where the mapping A : X — > Y is linear and K C X is a convex cone. The 
inverse of a set-valued mapping F is the mapping F^ 1 : Y =4 X defined by 



We call F singular if F _1 (0) ^ {0}. 

We typically denote the norm on a normed space X by || • || (or by || • \\x 
if we wish to be specific) and the closed unit ball in X by B x , and we 
denote the space of linear mappings from X to Y by L(X, Y). In particular, 
for a mapping A G L(X,Y), we denote the usual operator norm by \\A\\. 
We denote the dual space of X by X*, and we write the action of a linear 
functional x* G X* on an element x G X as (x*,x). We are particularly 
interested in rank-one mappings in L(X,Y), which are those mappings of 
the form x G X i— > (x*, a;)?/ for some given elements x* G X* and y G F: we 
denote the set of such mappings by L±(X, Y). The norm of this mapping is 
just \\x*\\ ■ \\y\\. 

In what follows, we interpret 1/0 = +oo and l/+oo = 0. 

Theorem 2.1 (rank-one reduction) Consider finite- dimensional normed 
spaces X, Y, U, V , a positively-homogeneous set-valued mapping F : X =4 Y , 



gP hF = {(x,y)EXxY:yeF(x)} 




(x G K) 
(x G" K) 



x G F 1 {y) y G F(x). 



3 



and linear mappings P : V — > Y and Q : X — > [/. T/ien £/ie quantity in 
[0, +00] defined by 



a = 




is unchanged if we further restrict the infimum to be over mappings T of rank 
one. Furthermore, if we assume 



Note We address the question of the attainment in the above infimum and 
supremum in the next section. 

Proof Denote the right hand side of the last equation by (5. Consider first 
the case where F is singular. In this case, clearly a — 0, and is attained by 
choosing the rank-one mapping T = 0. Choose any nonzero x\ G F _1 (0), 
so by assumption, Qx\ 7^ 0. Now by choosing x = \x\ with A G R+ and 
v = in the definition of j3, and letting A grow, we see f3 = +00, so the result 
holds. We can therefore assume F is nonsingular. 

We next show a > 1/(3. Consider any feasible mapping T in the definition 
of a, so there exists a nonzero vector x G (F + PTQ) _1 (0). Hence we have 
-PTQx G F(x), so since F _1 (0) = {0}, we deduce TQx ^ 0. Positive 
homogeneity now implies 



G F(x) andx^O =>- Qx ^ 



(as holds in particular if Q is injective or F is nonsingular), then 



1 




a 



sup 

x£X, v£B v 





l = T J% y) {\\T\\--(F + PTQ)-\0)^{0}}. 
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Clearly we have the inequality 7 > a, so it now suffices to prove 7 < 1/(3. If 
(3 = there is nothing to prove, so we can assume (3 > 0. 

Consider any feasible vectors x and v in the definition of (3. Since /3 > 
we can assume Qx 7^ 0. There exists a norm-one linear functional u* G £/* 
satisfying (u*,Qx) = \\Qx\\. Now we have 

G F(ar) - Pv = F(x) - PTQx 

where T : U — > V is the rank-one linear map defined by 

\\Qx\\ 

Since we know ||n||* = 1 and \\v\\ < 1, we deduce 

1 



7<||T||< 



WQAY 



so I/7 > ||<5^||- Finally taking the supremum over all feasible vectors x and 
v in the definition of (3 shows I/7 > (3, as required. □ 

Notice that, if X = V, the mapping F is single- valued and linear, and the 
mappings P and Q are just the identity, then we recover the classical Eckart- 
Young theorem. 

We next generalize to perturbations with a composite structure. In con- 
formity with our previous usage, for z G R+ we define 

j +00 (z > 0) 
0~\ (z = 0). 

Corollary 2.2 (rank-one reduction for sums) Given finite- dimensional 
normed spaces X, Y, Ui, Vi, a positively-homogeneous set-valued mapping F : 
X =4 Y , and linear mappings Pi : Vi — > Y and Qi : X — > C/j f/or « = 
1, 2, . . . , £/ie quantity 

a : = inf j max IITJ : F + P/TiQi singular) 

T t &L{U t ,Vi) l i Y 

unchanged if we further restrict the infimum to be over mappings Tj 0/ 
ran/; one. Consequently we have the following: 

a = inf ( max : 2jPjt>j G 
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k*,g^> >o vi}. 

Note As before, we address the question of the attainment in the above 
infima in the next section. 

Proof Fix any real e > and consider any feasible mappings Tj in the above 
infimum. By applying the preceding theorem we see there exists a mapping 
f k G L^Uk, V k ) satisfying ||T fc || < ||T fc || + e and 

(F + ^P&Qi + P k f k Q k y\o) + {0}. 
1=1 

We can continue in this fashion, arriving at mappings Tj G Li(Ui,Vi) satis- 
fying ||fi|| < ||Tj|| + e (for i— l,2,...,k) and 



Since e > was arbitrary, the rank-one reduction now follows. 
Consequently, we have a — cti, where 



«i : = cv n , cy { max IHIIKII : ^«,<5ix)P^ G F(x)\ 

inf { max ll-ydl ||m*|| : (u*, Qix)PiVi G F(x) } 

v u*eu*,o^xex\ i 11 11111 1,1 x ' v 7 J 



Vi£B v . 
< «2, 



where 



„4 fX { m f x IK*II : E «' Qi x ) p i y i ^ F ( x )}- 



Ol2 ' = 

On the other hand, suppose the vectors i>j, -u* and x are feasible in the 
infimum defining a±. If we define, for each index i, 

fr, ?.*\ - j (\\ v i\\~ lv i> INK) ( v i °) 
^ Ui) -\ (0,0) (v t = 0), 

then the vectors t>j, u* and x are feasible in the infimum defining a 2 , and 
ll^ill = \\ v i\\ \\ u i II f° r eacn This proves o 2 < so in fact a — a± — a 2 - 
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A completely analogous argument shows 



a = 

The final expression for a claimed in the theorem now follows, since the 
additional conditions (u*,Qix) > impose no essential restriction: for any 
index i we can always replace the pair of vectors (vi,u*) with (— vt, — u*) 
without changing feasibility or the objective value. 

Considering the definition of a 2 , we observe, for any vectors v iy 

inf ( max Ik* II : V (u*. Qix)PiVi G F(x)\ 

u*€t/*, OmGX, ^gR-l ^ « ^-r^ > 

since a feasible choice of the variables on the right hand side immediately 
gives a feasible choice on the left hand side with the same objective value, 
while for any feasible choice of vectors u* and x on the left hand side, setting 
il* = (sgn(u*,Qix))u* and fj = \(u*,Qix)\ for each index i gives a feasible 
choice on the right hand side with the same objective value. 

By observing that, for any vector x G X and scalar Zi G R+, we have 



mf r {||<||:«,g,x)=, J } = ^, 



u*eu* 

the result now follows. □ 
Note It is not hard to see that the case k — 1 gives back Theorem 2.1. 



3 Duality and surjectivity 

We return to our motivating example of the well-posedness of a linear map- 
ping A : X — > Y relative to a convex cone K C X (by which we mean AK = 
Y). If, as before, we define an associated set- valued mapping F : X =4 Y by 



{Ax} (x G K) 
(argiO, 



(3.1) = 
then well-posedness holds exactly when F(X) = Y. 
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We call a general set- valued mapping F : X =4 Y surjective if F(X) — Y, 
closed if its graph is closed, and sublinear if its graph is a convex cone. Sub- 
linear set-valued mappings are also known as convex processes. The notions 
of singularity and surjectiveness are intimately connected via duality: the 
adjoint of F is the set-valued mapping F* : Y* — > X* defined by 

G F*(y*) ^ (y*,y) > whenever y G 

The adjoint is easily seen to be closed and sublinear, and coincides with 
the classical notion for single- valued linear mappings. More generally, direct 
calculation shows that for any linear mapping G : X — > Y we have (F+G)* = 
F* + G*. It is simple to check that the adjoint of the set- valued mapping (3.1) 
is defined by F*(y*) = A*y* + K*, where K* C X* is the usual (negative) 
polar cone for K. 

The relationship between surjectiveness and singularity is described by 
the following concise result, a special case of an infinite-dimensional version 
of the open mapping theorem [1]. 

Theorem 3.2 (open mapping) For finite- dimensional normed spaces X 
and Y , a closed sublinear set-valued mapping F : X =4 Y is surjective if and 
only if its adjoint mapping F* is nonsingular. 

Note 3.3 If the closed sublinear set-valued mapping F is surjective, then so 
is the mapping F + G for all small linear mappings G, and the analogous 
result also holds for nonsingularity [10]. Hence with this assumption on F in 
Theorem 2.1 (rank-one reduction), the infimum 



is attained whenever finite, since it seeks the norm of the smallest element 
in a nonempty closed set. In this case, following the proof shows both the 
same infimum over the rank-one mappings T and the supremum 



inf 

T&L(U,V) 




sup 

xeX, v€B v 




are also attained. 
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Note 3.4 Using the preceding note, if the closed sublinear set-valued map- 
ping F is surjective in Corollary 2.2 (rank-one reduction for sums), then the 
infimum 

inf { max ||TJ : F + P{FiQi singular I 
T t &L{U t ,Vi) y. i y 

is attained whenever finite, whether over general or rank-one linear mappings 
Tj, and in this case the infimum 

inf { max 1 - : V" ^P^ G F(x)\ 

vi€B v .,zieB. + ,o^xex I i \\Qix\\ ^ J 

is also attained. 

Using the open mapping theorem (3.2), we can quickly derive a version of 
Corollary 2.2 (rank-one reduction for sums) for nonsurjectivity rather than 
singularity. 

Theorem 3.5 (rank reduction and surjectivity) For any finite- dimen- 
sional normed spaces X,Y,Ui,Vi, closed sublinear set-valued mapping F : 
X =4 Y , and linear mappings Pi : Vi — > Y and Qi : X — > Ui (for i = 
1, 2, . . . , k), the quantity 

a := ^ |nf ^ j max ||Tj|| : F + ^ pPiQj nonsurjective} 

is unchanged if we further restrict the infimum to be over mappings Ti of 
rank one, and in fact 



< i = inf { max „ * „ : V Zl Q*u* G F* (y*) ) 



«*eB [ , i *, 2l eR + ,o^*ey* I "T"~ ||P-*y* 

inf { max ||<|| : ]T (y*, P^)Q*< G F*(-y*), 



(y*,P.^> >0 Vi}. 

Furthermore, all four infima are attained if a is finite. 
Proof By the open mapping theorem, we have 

a = inf jmax||Tj|| : (f + '^P i T i Q^\ singular! 



inf { max ||^|| : F* + £ Q*T*P* singular}, 



TieL(Ui,Vi) <- i 



since the adjoint transformation * : L(Ui, Vi) — > L(V*, U*) leaves the norm 
fixed. This transformation is in fact a bijection, which also preserves the 
classes of rank-one mappings. Corollary 2.2 ensures the infimum is unchanged 
if we restrict to mappings Tj for which T* is rank-one, or in other words to 
rank-one Tj, as required. The final expressions follow directly from Corollary 
2.2. The final claim concerning attainment follows from Note 3.4. □ 



4 Duality 

Our ultimate aim is to express the structured distance to nonsurjectivity in 
terms involving the mapping F rather than its adjoint. For this purpose, the 
following result is crucial. 

Theorem 4.1 (theorem of the alternative) For any finite- dimensional 
normed spaces X,Y,Ui, surjective closed sublinear set-valued mapping F : 
X =4 Y , linear mappings Qi : X — > Ui, and vectors yi G Y (for i = 
1, 2, . . . , k), exactly one of the following two systems has a solution: 

(i) J2i w iUi £ F(x), \\Qix\\ < Wi G R for each i, x G X; 

(a) Ei {y*,Vi)Q>* e F*{- y *), o^ y *e Y*, 

(y*,Ui) > and u* G Bu* for each i. 

Proof Suppose first that both systems have solutions. By the definition of 
the adjoint, we deduce the inequality 

(-y*,J2 ^) ^ ( E (s/*> Vi)Q>l x ) 

i i 

or equivalently 

o>J2(y*,yi){™i + (ulQix))- 

i 

Now each term in the sum on the right hand side is a product of two factors, 
the first of which is nonnegative and the second of which is strictly positive. 
Hence this inequality can only hold if {y*,yi) = for each index i, and in 
this case we deduce G F*(—y*). But the mapping F is surjective, so by 
the open mapping theorem (3.2) its adjoint F* is nonsingular, and this is a 
contradiction. Hence at most one of the two systems has a solution. 
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Suppose now that system (i) has no solution. Then the two convex subsets 
of X x R k 

{(x,w) : ^^WiUi G F(x)} and w) : HQi^H < Wi for each 2} 

i 

are disjoint. Both sets are clearly nonempty, so there exists a separating 
hyperplane: there exists a nonzero vector (x*,w*) G X* x R k and a real /i 
such that the two implications 

J2 w iVi e i^x) =>> (x*, x) - ^ w>i > /i 

i i 

\\Qix\\ < Wi for each i =>- (x*,x) — '^2w*w i < /i. 

i 

Considering the first implication, by the positive homogeneity of F, we 
deduce 

(4.2) w ^ e F ( x ) =>• ( x *i X )~Y1 w >i ^ °- 

i j 

and fi < 0. This, in conjunction with the second implication, shows 

(4.3) w* > for each i, 
and 

(x*,x) < ^<||Q;x|| for all x eX. 

i 

This inequality expresses the fact that the vector x* is a subgradient at the 
origin for the convex function 

x ^^2w*\\Qix\\, 

i 

so by standard convex analysis we deduce 

(4.4) x*eJ2 w *iQ*iBu*. 

i 

We now apply a rather standard duality argument to the implication 
(4.2). We define a function / : Y — > [— oo, +oo] by 

f(y) = i nf CD : ?/ + J2 w iVi e F ( x )}- 
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Implication (4.2) shows /(0) = 0, and a standard elementary argument using 
the convexity of the graph of F shows / is convex. Since the mapping F is 
surjective, the function / never takes the value +00. Consequently (see [11]), 
/ has a subgradient y* G Y* at the origin, or in other words, 

V + Y^WiVi e F(x) => (y*,y) < (x*,x) - J2 w * w i- 

i i 

Setting x = and y = — X)i W %V% shows 

X><(< - (s/*,s/<)) < for a11 w e R fc , 

i 

SO 

(4.5) tu* = (y*,yi) for each i 
Furthermore, setting each Wi = shows 

yeF(x) =>■ (y*,y) < (x*,x), 

or in other words, 

(4.6) -x* G F*(-y*). 

Finally, putting together the relationships (4.3), (4.4), (4.5), and (4.6), shows 
we have constructed a solution to system (ii) in the theorem statement, as 
required. □ 

A helpful restatement of the above theorem is contained in the following 
duality result. Recall our convention z/0 = +00 for real z > 0. 

Theorem 4.7 (duality) Consider finite-dimensional normed spaces X, Y , 
Ui, a surjective closed sublinear set-valued mapping F : X =4 Y , linear 
mappings Qi : X — > Ui, and vectors G F (/or i = 1, 2, . . . , fcj. JTien £/ie 
function $ : F fe — > [0, +00] defined by 

(4.8) $((&))= sup {min— ^- : ]Tu^ G F(rr)}. 

is lower semicontinuous, and 

inf {maxIKH : £<i/',fc)QX G *"(-V*), (l/*,Ifc> > V*}. 
Furthermore, the infimum on the right hand side is attained whenever finite. 
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Proof We first prove the lower semicontinuity. For each index % consider a 
sequence of vectors y\ — > yi in the space Y , and consider a sequence of reals 
s r — > s as r — > oo satisfying s r > $((y[)), or in other words 



(4.9) rr G X, < G R and ^w^l G F(x) =>- s r > min 



n — 

i 



\\Qix\\ ' 



Consider reals Wi > (for each i) satisfing Y^iWiUi G F(x). We want to show 
the inequality 



Wi 

s > mm 



\\Qi x \\ 

To see this, we first note that, since F is surjective, it is everywhere open: 
the image under F of any open set is open. In particular, for any real 5 > 0, 
the set F(x + int 5B X ) is an open neighbourhood of the vector J2i w iUi, so f° r 
large r must contain the point ^i w iUi- Using this tool, we see there exists 
a subsequence R of the natural numbers such that 

^Wiyl e F(x r ) for all r G R 

i 

lim x T = x. 
Applying property (4.9) shows 

s r > min ,, - 1 ,, for all r G R. 

~ 1 \\QiX r \\ 

Hence there exists an index j G {1,2, ... ,k} and a further subsequence R' 
of i? such that 

w ■ 

s r > „^ 3 n for a11 r e 
" IIQ^II 

Taking the limit as r — > oo shows 

. . Wi 
s > „ „ ,, > mm 



IIQj^ll * WQ&W 

as required. Thus the function <£> is indeed lower semicontinuous. 

Denote the right hand side of the second claimed expression for <E> by 
^((lli))' we next want to prove that this infimum is attained whenever ty((jji)) 
is finite. Notice that the infimum is unchanged if we add the condition 
||y*|| = 1, using positive homogeneity. Now suppose that the infimum is 
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finite, so there exist feasible vectors u* and y*. If we define (3 = max; \\u*\\, 
then we can rewrite the infimum as 



* Jpf { max lk*ll : Efo'.iOGX e ^*(-y*), llvll = i, 

(y*,Vi)>0, \\u*\\<pvi}. 



This is the infumum of a continuous function over a nonempty compact set, 
so is attained. 

It remains to prove that the two functions $ and \& are identical. Consider 
any real ip > 0. Using the attainment property we have just proved for \&, 
the statement ^((yj)) < ^ is equivalent to the solvability of the system 

(y*,Vi) > 0, -u* G V'-Sfy* for each i, 
or equivalently, to the solvability of the system 

(y*, ip~ l yi) > 0, -u* G for each i 

Using the theorem of the alternative (4.1), this is equivalent to the unsolv- 
ability of the system 

'^2w i ip~ 1 y i G F(x), \\Qix\\ < Wi G R for each i, iGl, 

or equivalently (since F is positively homogeneous), to the unsolvability of 
the system 

WiVi G F(x), ib < ,. * .. . < Wi G R for each i, rr G X. 

t ii^ii 

But this in turn is equivalent to the statement <3>((yj)) < ib. To summarize, 
we have shown, for all real ib > 0, 

*((&)) <^ ^ $((&)) <V- 

The result now follows. □ 
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5 The main result 



We now have all the tools we need to derive our main result. 

Theorem 5.1 (distance to nonsurjectivity) For any finite- dimensional 
normed spaces X, Y, U, Vi, closed sublinear surjective set-valued mapping F : 
X =4 Y , and linear mappings Pi : Vi — > Y and Qi : X — > U (for i = 
1, 2, . . . , k), the following four quantities are equal: 

inf I max ||Tj|| : F + ^ P{FiQi nonsurjective >; 
inf j max llTd! : F + P/TiQi nonsuriectivej; 

rank-one T.eL^y,) 1 * ■ ^ 



inf I max — : V ZiQ*u* G 

inf sup \ min-^— -.J^WiPiVi <E F(x)\. 

Vi£B Vi xe x,wi>o 1 1 ||Qia:|| j J 

Furthermore, if these quantities are finite, each infimum above is attained. 

Proof The equality of the first three expressions follows immediately from 
Theorem 3.5 (rank reduction and surjectivity). The last expression also 
follows from the same result, after applying the duality theorem (4.7). □ 
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